Makefile: : Parallel Dependency Specification Language

نویسندگان

  • Alberto Simões
  • Rúben Fonseca
  • José João Almeida
چکیده

Some processes are not easy to be programmed from scratch for parallel machines (clusters), but can be easily split on simple steps. Makefile::Parallel is a tool which lets users specify how processes depend on each other. The language syntax resembles the well known Makefile[1] format, but instead of specifying files or targets dependencies, Makefile::Parallel specifies processes (or jobs) dependencies. The scheduler reads the specification and submits jobs to the cluster scheduler (in our case, Rocks PBS) waiting them to end. When each process finishes, dependencies are calculated and direct dependent jobs are submitted. Makefile::Parallel language includes features to specify parametric rules, used to split and join processes dependencies: some tasks can be split into smaller jobs working on different portions of files, and at the end, another process can be used to join results.

برای دانلود رایگان متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Generating Data Flow Programs from Nonprocedural Specifications

Data flow is a mode of parallel computation in which parallelism in a program can be exploited at the fine grained as well as macro level. A data flow computer executes a data dependency graph rather than the program counter controlled sequence of instructions executed by conventional machines. Nonprocedural languages appear to be especially appropriate high level languages for data flow comput...

متن کامل

tmk – A Multi-Site, Multi-Platform System for Software Development

tmk is a tool that embeds the functionality of make in the scripting language Tcl in a very simple and convenient way. Furthermore, tmk allows higher levels of abstraction via modules and a flexible configuration framework. In addition to using tmk simply as a replacement for make, the users can create projects with global methods, objects, and options, and extend or modify the globally defined...

متن کامل

Using Make for Reproducible and Parallel Neuroimaging Workflow and Quality-Assurance

The contribution of this paper is to describe how we can program neuroimaging workflow using Make, a software development tool designed for describing how to build executables from source files. A makefile (or a file of instructions for Make) consists of a set of rules that create or update target files if they have not been modified since their dependencies were last modified. These rules are ...

متن کامل

Software Packager User's Guide

Software integration is a growing area of concern for many programmers and software managers because the need to build new programs quickly from existing components is greater than ever. This includes building versions of software products for multiple hardware platforms and operating systems, building programs from components written in different languages, and building systems from components...

متن کامل

Some Elements of Amodula-2 Development Environment

We present some language-specific tools for the development of Modula-2 program systems. Specifically, we elaborate on an extended Modula-2 syntax checker, a makefile generation utility, a Modula-2 structure analyser and a cross reference utility.

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

عنوان ژورنال:

دوره   شماره 

صفحات  -

تاریخ انتشار 2007